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Abstract 

We consider a recurrent random walk (RW) in random environment 
(RE) on a strip. We prove that if the RE is i. i. d. and its distribution 
is not supported by an algebraic subsurface in the space of parameters 
defining the RE then the RW exhibits the (logt)^ asymptotic behaviour. 
The exceptional algebraic subsurface is described by an explicit system of 
algebraic equations. 

One-dimensional walks with bounded jumps in a RE are treated as 
a particular case of the strip model. If the one dimensional RE is i. i. 
d., then our approach leads to a complete and constructive classifica- 
tion of possible types of asymptotic behaviour of recurrent random walks. 
Namely, the RW exhibits the (logt)^ asymptotic behaviour if the distribu- 
tion of the RE is not supported by a hyperplane in the space of parameters 
which shall be explicitly described. And if the support of the RE belongs 
to this hyperplane then the corresponding RW is a martingale and its 
asymptotic behaviour is governed by the Central Limit Theorem. 
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1 Introduction 

The aim of this work is to describe conditions under which a recurrent random 
walk in a random environment (RWRE) on a strip exhibits the log^ t asymptotic 
behaviour. This slow, lingering movement of a walk was discovered by Sinai in 
1982 [T^. At the time, this work had brought to a logical conclusion the study 
of the so called simple RWs (SRW) started by Solomon in 19J and by Kesten, 
Kozlov, and Spitzer in (141. The somewhat misleading term "simple" is often 
used as an abbreviation describing a walk on a one-dimensional lattice with 
jumps to nearest neighbours. 

Our work was motivated by a question asked by Sinai in [18] about the 
validity of his (and related) results for other models. Perhaps the simplest 
extension of the SRW is presented by a class of one-dimensional walks whose 
jumps (say) to the left are bounded and to the right are of length at most one. 
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These models were successfully studied by a number of authors and the relevant 
references can be found in [2]. We would like to quote one result concerning 
this special case since it is perhaps most close to our results stated below in 
Theorems [U and [31 Namely, Bremont proved in [S] that if the environment is 
defined by a Gibbs measure on a sub-shift of finite type, then the asymptotic 
behaviour of a recurrent RW is either as in the Sinai's theorem, or it is governed 
by the Central Limit Law. 

General IDWBJ were also studied by different authors. Key in [Kj found 
conditions for recurrence of a wide class of IDWBJ. Certain sufhcient conditions 
for the Sinai behaviour of IDWBJ were obtained by Letchikov in [17]. The 
results from [17] will be discussed in a more detailed way in Section 11.11 after 
the precise definition of the one-dimensional model is given. We refer the reader 
to [5D] for further historical comments as well as for a review of other recent 
developments. 

The main object of this paper is the RWRE on a strip. We prove (and this 
is the main result of this paper) that recurrent walks in independent identically 
distributed (i. i. d.) random environments on a strip exhibit the log^t asymp- 
totic behaviour if the support of the distribution of the parameters defining 
the random environment does not belong to a certain algebraic subsurface in 
the space of parameters. This subsurface is defined by an explicit system of 
algebraic equations. 

The one dimensional RW with bounded jumps can be viewed as a partic- 
ular case of a RWRE on a strip. This fact was explained in [1] and we shall 
repeat this explanation here. Due to this reduction, our main result implies a 
complete classification of recurrent IDWBJ in i.i.d. environments. Namely, the 
corresponding system of algebraic equations reduces in this case to one linear 
equation which defines a hyperplane in the space of parameters. If the support 
of the distribution of parameters does not belong to the this hyperplane, then 
the RW exhibits the Sinai behaviour (see Theorem [2| below). But if it does, 
then (Theorem [3| below) the corresponding random walk is a martingale and its 
asymptotic behaviour is governed by the Central Limit Law. In brief, recurrent 
IDWBJ are either of the Sinai type, or they are martingales. 

In the case of a strip, a complete classification can also be obtained and it 
turns out that once again the asymptotic behaviour is cither the Sinai, or is 
governed by the Invariance Principle. However, this case is less transparent and 
more technical even to describe in exact terms and we shall leave it for a future 
work. 

The paper is organized as follows. We state Sinai's result and define a more 
general one-dimensional model in Section FLlI Section ri.2l contains the definition 
of the strip model and the explanation of the reduction of the one-dimensional 
model to the strip case. Main results are stated in Section [T31 Section[2|contains 
several statements which are then used in the proof of the main result. Theorem 
[TJ In particular, we introduce random transformations associated with random 
environments in Section 12.21 It turns out to be natural to recall and to extend 
slightly, in the same Section 12.21 those results from [T] which are used in this 
paper. An important Lemma [S| is proved in Section |2.3| this Lemma allows us 
to present the main algebraic statement of this work in a constructive form. In 
section [2.41 we prove the invariance principle for the log of a norm of a product 
of certain matrices. This function plays the role of the so called potential of the 
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environment and is responsible for the Sinai behaviour of the random walk. It 
is used in the proof of our main result in Section [31 

Finally Appendix contains results of which many (if not all) are not new but 
it is convenient to have them in a form directly suited for our purposes. Among 
these, the most important for our applications is the Invariance Principle (IP) 
for "contracting" Markov chains fSection I4.1.3p . Its proof is derived from a 
well known IP for general Markov chains which, in turn, is based on the IP for 
martingales. 

Conventions. The following notations and terminology shall be used through- 
out the paper. M is the set of real numbers, Z is the set of integer numbers, and 
N is the set of positive integers. 

For a vector x = (xi) and a matrix A = {a{i,j)) we put 

max \xi\, \\A\\ max'Y^ |a(i, j)|. 

j 

Note that \\A\\ = sup^,j.^^i We say that A is strictly positive (and write 

A > 0), if all its matrix elements satisfy a{i,j) > 0. A is called non-negative 
(and we write A > 0), if all a{i, j) are non negative. A similar convention applies 
to vectors. 

1.1 Sinai's result and some of its extensions to IDWBJ. 

Let uj (pn)-oo<n<oo bc a sequence of independent identically distributed (i. 
i. d.) random variables, satisfying e < < 1 — e, where e > 0. Put qn = 1 — Pn 
and consider a random walk ^(t) on a one-dimensional lattice with a starting 
point ^(0) = and transition probabilities 

Pr^{ e(i + 1) = n + 1 I m = n}=pn, Pr^{ ^(i + 1) - n - 1 | ^t) = n} = q,, 

thus defining a measure Pr^{-} on the space of trajectories of the walk. It is 
well known (Solomon, [T^) that this RW is recurrent in almost all environments 
u! if and only if E In =0 (here E denotes the expectation with respect to the 
relevant measure P on the space of sequences). In [T^ Sinai proved that if 
E(ln ^)^ > and ^(•) is recurrent then there is a weakly converging sequence 
of random variables bt{uj), t — 1,2, ... such that 

{logt)-^^{t) -bt^O as t^oo. (1.1) 

The convergence in (II. ip is in probability with respect to the so called annealed 
probability measure V{duj)Pri^ (for precise statements see section II. 3p . The 
limiting distribution of bt was later found, independently, by Golosov [3 [S] and 
Kesten [13 . 

The one-dimensional walk with bounded jumps on Z is defined similarly to 
the simple RW. Namely let u) {p(n, •)), n e Z, be a sequence of non- negative 
vectors with J2T=-m.Pi''^' k) — 1 and m > 1. Put <^(0) = and 

Pr^{C{t + l)^n + k\^{t)^n)'^^^ pin,k), n G Z. (1.2) 

Suppose next that p{n, •) is a random stationary in n (in particular it can be i. 
i. d.) sequence of vectors. Sinai's question can be put as follows: given that a 
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RW is recurrent, what kind of asymptotic behaviour would one observe? and 
under what conditions? 

There were several attempts to extend Sinai's result to the (|1.2p model. In 
particular, Letchikov [T7j proved that if for some £ > with P-probability 1 

-2 m 

p{n,l-)> p{n,k)+£ and p{n, —1) > ^y^p{n, k) + e 

k— — rn k—2 

and the distribution of the i. i. d. random vectors p{n, •) is absolutely con- 
tinuous with respect to the Lebesgue measure (on the relevant simplex), then 
the analogue of Sinai's theorem holds. (In [17 , there are also other restrictions 
on the distribution of the RE but they are much less important than the ones 
listed above.) 

The technique we use in this work is completely different from that used in 
|15j . [T7] . [2], [3]. It is based on the methods from [T] and fS^ and this work 
presents further development of the approach to the analysis of the RWRE on 
a strip started there. 



1.2 Definition of the strip model. 

The description of the strip model presented here is the same as in [T] . 

Let {Pn,Qn, Rn), — oo<n<oo, bca strictly stationary ergodic sequence 
of triples of to x m matrices with non-negative elements such that for all ri G Z 
the sum P„ + Qn + Rn is a stochastic matrix, 

{Pn + Qn+Rn)l = l: (1-3) 

where 1 is a column vector whose components are all equal to 1. We write 
the components of P„ as P„(i,j), 1 < j,j < to, and similarly for Qn and i?„. 
Let (57, !F, P, T) be the corresponding dynamical system with H. denoting the 
space of all sequences uj = (ijJ„) ~ {{Pn, Qn, Rn)) of triples described above, 
being the corresponding natural a-algebra, P denoting the probability measure 
on (fl,J-), and T being a shift operator on defined by (Tti>)„ = LOn+i- For 
fixed u! we define a random walk £,{t), t e N on the strip § = Z x {1, . . . , to} by 
its transition probabilities Quj{z,zi) given by 

Pn{i,j) if 2 = (n,z), zi = (n+ 1, j), 

n ^ )<isf } Rn{hj) if z = {n,i), zi = (n,j), , 

J.^{z,zi} - \ g^^(^^^.) if z = (n,z), zi = (n-l,j), ^ ' 

otherwise. 

This defines, for any starting point z = (n, i) G § and any a law Pr^^ z for 
the Markov chain ^(•) by 

P'W(?(1) = 2i,...,e(i) =2t) =^2^(2,^1)2^(21,22) •••Q^(zt-i,zt). (1.5) 

We call UJ the environment or the random environment on a strip §. Denote 
by S2 the set of trajectories ^(•) starting at 2. Pr^^ ^ is the so called quenched 
probability measure on S2. The semi-direct product F{duj)Pri^^zid£,) of P and 
Ptui,z is defined on the direct product x S2 and is called the annealed measure. 
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All our main results do not depend on the choice of the starting point z. We 
therefore write Pr^ instead of Pr^^^z when there is no danger of confusion. 

The one-dimensional model (|1.2p reduces to a RW on a strip due to the following 
geometric construction. Note first that it is natural to assume (and we shall do 
so) that at least one of the following inequalities holds: 

¥{uj : p{x,m) > 0} > or F{uj : p{x,-m) > 0} > 0. (1.6) 

Consider the one-dimensional lattice as a subset of the X-axis in a two-dimensional 
plane. Cut this axes into equal intervals of length m so that each of them con- 
tains exactly m consecutive integer points. Turn each of these intervals around 
its left most integer point anti-clockwise by 7r/2. The image of Z obtained in 
this way is a part of a strip with distances between layers equal to m. Re-scaling 
the X-axis of the plane by to~^ makes the distance between the layers equal to 
one. The random walk on the line is thus transformed into a random walk on a 
strip with jumps to nearest layers. 

The formulae for matrix elements of the corresponding matrices P„, Qn, Rn 
result now from a formal description of this construction. Namely, present a; g Z 
as X — nm + i, where 1 < i < m. This defines a bijection x (n, i) between 
the one-dimensional lattice Z and the strip S = Z x {1, . . . ,to}. This bijection 
naturally transforms the ^-process on Z into a walk on Z x { 1 , . . . , m} . The latter 
is clearly a random walk of type (jl.Sp and the corresponding matrix elements 
are given by 

Pnihj) ^pinm + i,m + j-i), 

Rn{i,j)=p(nni + i,j-i), (1.7) 
Qnihj) =p{nm + i,-m + j - i). 

1.3 Main results. 

Denote by the following set of triples of to x to matrices: 

J =^ {(P, Q, i?) : P > 0, Q > 0, i? > and (P + Q + P)l = 1} . 

Let iTo C be the support of the probability distribution of the random triple 
(P„, Qm Rn) defined above (obviously, this support does not depend on n). The 
two assumptions CI and C2 listed below will be referred to as Condition C. 

Condition C 

CI {Pn,Qn, Rn), — oo<n<cxD, isa sequence of independent identically dis- 
tributed random variables. 

C2 There is an e > and a positive integer number I < oo such that for any 
(P, Q, R) G Jo and all i, j £ [1, to] 

\\R'\\<l-e, ((/-P)-ip)(i,j)>e, iiI-R)-'Q)ii,j)>e. 

Remarks. 1. We note that say ((/ — Rn)^^ Pn)(i, j) is the probability for a 
RW starting from {n,i) to reach (n + l,j) at its first exit from layer n. The 
inequality ||P^|| < 1 — £ is satisfied in essentially all interesting cases and, 
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roughly speaking, means that the probabihty for a random walk to remain in 
layer n after a certain time I is small uniformly with respect to n and lo. 

2. If the strip model is obtained from the one-dimensional model, then C2 
may not be satisfied by matrices (|1.7p . This difficulty can be overcome if we 
replace C2 by a much milder condition, namely: 

C3 For P - almost aU w: 

(a) the strip § is the (only) communication class of the walk, 

(b) there is an e > and a triple (P, Q, i?) G Jo such that at least one 
of the following two inequalities holds: ((/ — R)~-^ P){i, j) > e for all 
i, j e [1, m], or ((/ — R)~^Q){i,j) > e for all i, j £ [1, m]. 

Our proofs will be carried out under Condition C2. They can be modified 
so that to make them work also under Condition C3. Lemma |6] which is used 
in the proof of Theorem [1] is the main statement requiring a more careful treat- 
ment under condition C3 and the corresponding adjustments are not difficult. 
However, the proofs become more technical in this case, and we shall not do 
this in the present paper. If now vectors p{x, •) defining matrices ()1.7p are P- 
almost surely such that p(x, 1) > e and p{x, — 1) > e for some e > 0, then it is 
easy to see that Condition C3 is satisfied. We note also that if in addition the 
inequalities p{x, m) > e and p{x, —m) > e hold P-almost surely, then also C2 is 
satisfied. 

For a triple of matrices (P, Q, R) £ Jo denote by tt = ttjp g = (tti , . . . , tt™) 
a row vector with non-negative components such that 

m 

7r(P + Q + i?) = vr and ^ tt^ = 1. 

i=i 

Note that the vector tt is uniquely defined. Indeed, the equation for tt can be 
rewritten as 

7r(/ - R) ((/ - R)-^P Ry^Q) = n{I - R). 

According to condition C2, the stochastic matrix (/— R)^^P+ (/— R)^^Q has 
strictly positive elements (in fact they are > 2e). Hence tt{I — R) is uniquely (up 
to a multiplication by a number) defined by the last equation and this implies 
the uniqueness of tt. 

Consider the following subset of J: 

Jai '^^^ { {P, Q,R)eJ: tt{P - Q)l = 0, where n{P + Q + R) = n }, (1.8) 

where obviously 7r(P - Q)l = I]" i tt^ X]JLi(^(^ j) - ^(^ j))- Note that Jai is 
an algebraic subsurface in J. 

We are now in a position to state the main result of this work: 

Theorem 1 Suppose that Condition C is satisfied, the random walk ^(•) = 
[X{-),Y{-)) is recurrent, and Jq (f_ Jai- Then there is a sequence of random 
variables bt{uj), t — 1,2, which converges weakly as t ^ oo and such that for 
any e > 

P jcc; : Pr^ (' - 6t| < > 1 - e| ^ 1 as t^^. (1.9) 



6 



Remark. The algebraic condition in this Theorem requires a certain degree 
of non-degeneracy of the support j7o of the distribution of (P„, Rn)- It niay 
happen that relations (|1.9p hold even when j7o C Jai ■ However Theorem [3] 
shows that there are important classes of environments where relations ()1.9p (or 
()1.11|) ) hold if and only if this non-degeneracy condition is satisfied. 

We now turn to the one-dimensional model. It should be mentioned right 
away that Theorem [5] is essentially a corollary of Theorem [1] 

Denote by J the set of all 2m + 1-dimensional probability vectors: 

m 

J {(p(j))_™<,<„. : p{-) > and ^ p(j) = 1 }. 

3=-m 

Remember that in this model the environment is a sequence of vectors: uo = 
•))-oo<a;<oo' where p[x, ■) G J. Let Jq C J he the support of the distri- 
bution of the random vector p(0, •). Finally, put 

m 

Jai = {p{-)ej: ^jp(j) = 0}. (1.10) 

j=-m 



Theorem 2 Suppose that: 

(a) p{x, •), a; G Z, is a sequence of i. i. d. vectors, 

(b) there is an e > such that p(0, 1) > e, p(0, — 1) > e, p{0,m) > e, and 
p{0, -to) > £ for any p(0, •) G Jo, 

(c) for¥ almost all environments uj the corresponding one- dimensional random 
walk ^{■) is recurrent, 

(d) Jo t Jal- 

Then there is a weakly converging sequence of random variables bt{uj), t = 
1, 2, ... such that for any e > 

P : Pr^ (l (1^^ - 6^1 < > 1 - e| ^ 1 as t ^ ^. (1.11) 

Proof. Since the one-dimensional model reduces to a model on a strip, the 
result in question would follow if we could check that all conditions of Theorem 
[T] follow from those of Theorem [21 

It is obvious from formulae (|1.7p that the i. i. d. requirement (Condi- 
tion CI) follows from condition (a) of Theorem [2] We have already mention 
above that and Condition C2 follows from condition (b). The recurrence of the 
corresponding walk on a strip is also obvious. 

Finally, condition {d) implies the algebraic condition of Theorem [T] Indeed, 
formulae (|1.7p show that matrices P„, Q„, i?„ are defined by probability vectors 
p{nm + i, ) G j7o, where 1 < i < m. Put n ~ and choose all these vectors to 
be equal to each other, say p{i, •) = p{-) G Jo, where 1 < i < m. A direct check 
shows that the triple of matrices (P, Q, R) built from this vector has the property 
that P -I- Q -I- P is double-stochastic and irreducible (irreducibility follows from 
the conditions p{l) > e and p{—l) > e). Hence the only probability vector tt 
satisfying 7r(P + Q + R) = vr is given by tt = (to^^, ...,m^^). One more direct 
calculation shows that in this case 

m 

TO7r(p-g)i ^ Mj)- 

j = -m 
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Hence the condition J7o ^ Jai of Theorem [T] is satisfied if there is at least one 
vector p(-) e such that 7^ 0. □ 

We conclude this section with a theorem which shows, among other things, 
that the algebraic condition of Theorem [5] is also necessary for having 
This theorem does not require independence as such but in a natural sense it 
finalizes the classification of the one-dimensional recurrent RWs with bounded 
jumps in the i. i. d. environments. 

Theorem 3 Consider a one- dimensional RW and suppose that 

(a) p{x, •), X Cz Z, is a strictly stationary ergodic sequence of vectors, 

(h) there is an e > such that p{0, 1) > e and p(0, —1) > e for any p(0, •) € j7o, 

(c) Jo C Jai, that is 



X! -^p^-?) ^ ^ f^"^ °''^y ^(■) ^ 



]=-m 

Then: 

(i) The random walk ^(•) is asymptotically normal in every(!) environment 

(ii) There is a a > such that for P-a. e. lu 

hm Pr^\^ <x\ ^ [ e~^du, (1.12) 



where x is any real number and the convergence in hi .12]) is uniform in x. 

Remarks about the proof of Theorem [3l The condition of this Theorem 
implies that ^(i) is a martingale: 

m 

m -^{t-i)\at-i)^k)^ Mk,j) = 0, 

where E^^ denotes the expectation with respect to the probability measure Pr^ 
on the space of trajectories of the random walk (we assume that ^(0) = 0). Let 
Un = ^.in) — ^(n — 1) and put 

m 

j = -m 

Obviously e < ct,^ < m^, where e is the same as in Theorem [3] Next put 
Vn =^ EJ=i<^| and 4 =^ E^{V^) = E^{i{nf). It is useful to note that 
ne < V^, si < nm"^. Let Tt = inf{n : > t}. 

Statement {i) of Theorem [3] is a particular case of a much more general 
theorem of Drogin who in particular proves that t-i/2^(Tt) converges weakly to 
a standard normal random variable. We refer to [12], page 98 for more detailed 
explanations. 

Statement (ii) of Theorem[3]is similar to a well known result by Lawler [16j . 
The main ingredient needed for proving (ii) is the following claim: 

The limit lim n^^V^ = lim n~^s1 exist for P-almost all uj. (1-13) 
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Once this property of the variance of <^(-) is estabhshed, (m) becomes a corohary 
of Brown's theorem (see Theorems!^ andlTUlin Appendix or Theorem 4.1 in 12J). 

However proving (jl.l3p is not an entirely straightforward matter. The proof 
we are aware of uses the approach known under the name "environment viewed 
from the particle" . This approach was used in [16j for proving properties of 
variances similar to (|1.13p : unfortunately, the conditions used in ^6j, formally 
speaking, are not satisfied in our case. Fortunately, Zeitouni in found the 
way in which Lawler's result can be extended to more general martingale-type 
random walks in random environments which include our case. □ 

2 Preparatory results. 

2.1 Elementary corollaries of condition C. 

We start with several elementary observations following from C2. Lemma [3] 
and a stronger version of Lemma [T] can be found in Ij . Lemmas [5] and [H are 
borrowed from [6]. 

Lemma 1 // Condition C2 is satisfied then for ¥-almost every environment lo 
the whole phase space S of the Markov chain ^(t) constitutes the (only) commu- 
nication class of this chain. 

Proof. Fix an environment lu and consider matrices 

Remark that Pn{i,j) is the probability that the random walk ^ starting at (n, i) 
would reach (n + 1, j) at the time of its first exit from layer n; the probabilistic 
meaning of Qn{hj) is defined similarly. Pn{i,j) > £ > and Qnihj) > e > 
because of condition C2. It is now obvious that a random walk ^(•) starting 
from any z £ S would reach any zi g S with a positive probability. □ 

Matrices of the form (/-i?-QV)"\ {I - R-Qip)''^ and {I - R-Qip)'^Q 
arise in the proofs of many statements below. We shall list several elementary 
properties of these matrices. 

Lemma 2 // condition C2 is satisfied, {P, Q, R) G j7o and tjj is any stochastic 
matrix, then there is a constant C depending only on e and m such that 

- R-Qijj)-^\\<C. (2.1) 

Proof. Note first that < 1 — £ implies that for some Ci uniformly in 

R 

00 

ii(/-i?r'ii<Eii^'ii^c'i. 

fe=0 

Next, it follows from {P + Q + R)l = 1 that {I - R)-^ P1 + (I - R)-^Q1 = 1 and 
{I-R)-^Q1 = 1-{I-R)-^P1. Condition C2 implies that {I-R)-^P1 > mel. 
Hence 

\\{I-R)-^Q\\ = ||(/-i?)-^Ql|| = ||l - {I-R)-^Pl\\ < 1-me. 
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Similarly, ||(/ — i?) ^^'|| < 1 — me. Hence 

||(/-i?-gi^)-i|| = \\{I - {I - R)-^QiP)-^{I - R)-^\\ 

< {1 - - R)-^Qij\\)-^ - R)-m <Cim-^e-^ = C. 

Lemma is proved. □ 

Lemma 3 ('ll) If condition C2 is satisfied, (P, Q, R) e , and tp is a stochas- 
tic matrix, then (I ~ R ~ Qip)^^P is also stochastic. 

Proof. We have to check that (I — R — Qip)^^Pl = 1 which is equivalent 
to PI = (/ - - ^ {P + Q'ip + R)l = 1. Since ^1 = 1 and P + Q + i? 
is stochastic, the result follows. □ 

Lemma 4 Suppose that condition C2 is satisfied and [P, Q, R) G jTo and let a 
matrix ip > be such that ipl <1. Then 

iiI-R-Q^)-'P)ii,j)>e and {{I - R ^ Q^)-^Q){i, j) > e. (2.2) 

Proof. {I-R-Qip)-^P > {I-R)-^P and {I-R-Qip)-^Q > {I-R)-^Q. 

□ 

2.2 Random transformations, related Markov chains, Lya- 
punov exponents, and recurrence criteria. 

The purpose of this section is to introduce objects listed in its title. These 
objects shall play a major role in the proofs of our main results. They shall also 
allow us to state the main results from [T] in the form which is suitable for our 
purposes. 

Random transformations and related Markov chains. 

Let ^ be the set of stochastic mx m matrices, X be the set of unit vectors with 

dcf 

non-negative components, and M = \1/ x X the direct product of these two sets. 
Define a distance •) on M by 

p{(i^,x), = I IV - V/|| + (2.3) 

For any triple (P, Q, R) G j7o denote hy g = g(p^Q^R) a transformation 

5:Mh^M, where g.{il),x)'^= {{I - R - Q^j^^ P , \\Bx\\-^ Bx), (2.4) 

and 

B = B^p^Q^R) {^) {I-R- Qi,)-^Q. (2.5) 

The fact that g maps M into itself follows from Lemma [31 

Remark. Here and in the sequel the notation g.{tp, x) is used instead of g{{ip, x)) 
and the dot is meant to replace the brackets and to emphasize the fact that g 
maps {'ijj, x) into another pair from M. In fact this notation is often used in the 

theory of products of random matrices, e. g. B.x '= \\Bx\\~^ Bx; we thus have 
extended this tradition to another component of g. 

If a; G O is an environment, lu = (t^n)-oo<n<oo, where LUn (Pm Qn, Rn) G 
j7o , then (|2.4p allows us to define a sequence gn = g^^ of random transformations 
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of M. Given the sequence we define a Markov chain with a state space j7o xM. 
To this end consider an a € Z, and a (ipa, Xq) G M and put for n > a 

{■>pn+l,Xn+l) =^5n-(V'n,a:„) = ((/ - i?„ - (3„?/;„)"^-Pn , \\B„Xn\\^^ BnXn) , (2.6) 

where we use a concise notation for matrices defined by (|2.5p : 

Bn i?c.„(^„) = i?(p„,Q„,fl„)(V„). (2.7) 

Theorem 4 Suppose that Condition C is satisfied. Then: 

a) For P-a.e. sequence uj the following limits exist: 

C„ =^ Hm ipn, Vn =^ hm x„. (2.8) 

a — * — oo a — > — OQ 

and {Cn,yn) does not depend on the choice of the sequence {ipaTUa)- Furthermore, 
the convergence in \2. 8\) is uniform in {ipa,Xa)- 

b) The sequence of pairs (Cn,yn) = (Cn(w), y„(a;)) — oo < n < oo, is the 
unique sequence of elements from M which satisfy the following infinite system 
of equations 

(C„+l,?/«+l) = ((/ - i?„ - QnCn)"^^n 7 \\An{uj)y„\\~^ An{uj)y„) , rt G Z, 

(2.9) 

where 

A„ = A^iiu) (/ - i?„ - QnCny'Qn. (2.10) 

c) The enlarged sequence (ci;„, C„, — oo < n < oo, forms a stationary and 
ergodic Markov chain with components ujn and {C,myn) being independent of 
each other. 

Proof. The first relation in (|2.8p is the most important statement of our 
Theorem and it also is the main content of Theorem 1 in [T]; it thus is known. 

The main difference between this Theorem and Theorem 1 from jT] is that 
here we consider the extended sequence {ipn,Xn), n > a, rather than just 
(ipn), n> a. The proof of the second relation in (|2.8p is based on two observa- 
tions. First note that the first relation in (|2.8p implies that lima_>_oo -B„ = An- 
Next, it follows from the definition of the sequence Xn that 

Xn = \\Bn-l ■ ■ ■ BaXaW^^ Bn-l . ■ ■ BaXa- (2.11) 

Estimates ()2.ip and ()2.2p imply that Taiui-^^i^MM -^k^i''-^T^'^)-^ki'i3,H) > £ for 
some e > and hence also miui-^^i^^i^.i^ A^^(ii, i2)Afc(i3, ii) > e. It is well known 
(and can be easily derived from Lemma llSp that these inequalities imply the 
existence of 

lim \\AnAn-l...A 

aXa\\ ^n^n— 1 • ■ . AaXa 

a — > — QO 

and this limit does not depend on the choice of the sequence Xa > 0, ||a;a|| — 1. 
Combining these two limiting procedures we obtain the proof of the second 
relation in (|2.8p . 

Part b) of the Theorem is proved exactly as part b) of Theorem 1 from [T] . 
The Markov chain property and the independence claimed in part c) are 
obvious corollaries of the independence of the triples (P„, Qn, Rn)- And, finally. 
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the ergodicity of the sequence (t^^n, Cm is due to the fact that the sequence 
u>n is ergodic and the {CmUn) is a function of {ujk)k<n-i- D 

Remark. The proof of Theorem 1 in [T] was obtained under much less restric- 
tive assumptions than those hsted in condition C of this work. In particular, 
the i. i. d. condition which we impose on our environments (rather than having 
them just stationary and ergodic) is unimportant for parts a) and b) of Theorem 
13] as well as for Theorem [Sj However, the i. i. d. property is important for the 
proof of our main results. 

The top Lyapunov exponent of products of matrices An and the re- 
currence criteria. 

The top Lyapunov exponent of products of matrices An will be denoted by A 
and it is defined by 

A lim -logP„v4„-i...^i|l. (2.12) 

n — >oo TL 

The existence of the limit in (|2.12p with P-probability 1 and the fact that A 
does not depend on uj is an immediate corollary of the Kingman's sub-additive 
ergodic theorem; it was first proved in [5l . The Furstenberg formula states that 

A= / \og\\{I - R- QC)-'Qyy{dgMd{C,y)), (2.13) 

JJoxM 

where i'{d{C,,y)) is the invariant measure of the Markov chain ()2.6p and iJ-{dg) 
is the distribution of the set of triples {P, Q, R) supported by j7o (defined in 
section [T75|) . We use the shorter notation dg rather than d{P,Q,R) because, 
as we have seen above, every triple (P, Q, R) € jTo defines a transformation g. 
Besides, this notation is consistent with the one used in section [4. 1.31 

We remark that a proof of ()2.12p and (|2.13p will be given in section [53] as a 
natural part of the proof of the invariance principle for the sequence of random 
variables log ||A„yl„_i . . . 

We finish this section by quoting the recurrence criteria proved in [1] . 

Theorem 5 Suppose that Condition C is satisfied. Then 

a) X ^ if and only if for P-a.e. environment to one has (respectively) 

lim ^{t) — =pcx) Pri^ -almost surely. 

t — >oo 

b) X = if and only if for P-a.e. lu the RW is recurrent, that is 

lim sup ^(t) = +00 and liminf ^(t) — — oo Pr^-almost surely. 

2.3 One algebraic corollary of Theorems |4] and [5l 

Theorems U] and [5] combined with a simple probabilistic observation lead to an 
algebraic result which plays a very important role in the proof of our algebraic 
condition. 

Suppose that the matrices (P„, Q„, i?„) do not depend on n: {Pn, Qm Rn) = 
(P, Q, R), and the triple (P, Q, R) satisfies condition C2. In this case relations 
(|2.8p mean that Cn = C ^-nd yn = y, where C is a unique stochastic matrix and 
y > a unique unit vector such that 

C = (/ - i? - QC)~'^, and Ay^e^y, (2.14) 
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where the matrix A is defined by 



A = (I-R-QO-'Q- 

Theorem[S]now states that a random walk in a constant environment is recurrent 
if A = 0, transient to the right if A < 0, and transient to the left if A > 0. 

But the fact that the random environment does not depend on n allows one 
to analyse the recurrence and transience properties of the random walk in a way 
which is much more straightforward than the one offered by Theorems |4] and [5l 

Namely, suppose that £,{t) = {X{t),Y{t)) = {k,i). Then the conditional 
probability Pr{Y{t) = j\^{t-l) = {k,i)} = P{i, j) + Q{i, j) + R{i, j) does not 
depend on X{t — 1) and thus the second coordinate of this walk is a Markov 
chain with a state space (1, to) and a transition matrix P + Q + R. Hence, 
if TT = (tti, ...TTm) is a probability vector such that tt{P + Q + R) ~ tt then tTj is 
the frequency of visits by the RW to the sites (•,«) of the strip. 

Consider next the displacement ri{t) X{t) — X{t — 1) of the coordinate 
X of the walk which occurs between times t — 1 and t. The random variable 
ri{t) takes values 1, -1, or and the following conditional distribution of the 
pair (r?(t),F(t)) is given by Pr{ {v{t),Yit)) = - (fc, i)} - j), 

Pr{{7it),Y{t)) = = (fc,i)} = Q{i,j), and Pr{ {r]{t),Y{t)) = 

(Oii) ~ 1) = (fc)*)} — It is essential that this distribution depends 

only on i (and not on k) and thus this pair forms a time-stationary Markov 
chain. Let us denote by E^}~ i-^ the corresponding conditional expectation with 
conditioning on {rj{t — \),Y{t~ 1)) = —1 <k <1, 1 < m. We then have 

rri m 

and the expectation of the same random variable with respect to the stationary 
distribution is thus given by X^I^i ~ Qihj))- Applying the law 

of large numbers for Markov chains to the sequence ri{t) we obtain that with 
Pr-probability 1 



m m 



hm r^X{t) = hm Er7(A:) = ^ tt, ^(P(i, j) - Q{i,j)) 

t~>oo t^oo ^ — ^ ^ — ^ ^ — ^ 

fc=l i=\ j=\ 

and this limit is independent of the ^(0). Since this result is equivalent to the 
statements of Theorems |4] and El we obtain the following 

Lemma 5 . Suppose that {P,Q,R) satisfies Condition C2. Then (C, a^) G M 
satisfies equations {2.14-^ with X = if and only if 



m m 



^7r,^(P(i,j)-Q(z,j)) = 0. (2.15) 

i=i j=i 

Moreover \ > if and only i/ j) ^ Qihj)) < (and thus 
A < if and only Ej=i(-P(«>i) - Qi^j)) > 0)- 
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2.4 The CLT and the invariance principle for S^s. 

The main goal of this section is to prove an invariance principle (IP) (and a 
CLT) for the sequence 

5„ =^log||B„...BiXi|| -riA, (2.16) 

where matrices i?„ are defined by (|2.7p and A is given by (|2.13p . Obviously, Sn 
depends on (?/ji,a;i) G M. We shall prove that in fact the IP (and the CLT) 
are satisfied uniformly in (?/;i, xi) G M. Moreover, exactly one of the two things 
takes place if the random walk is recurrent: either the asymptotic behaviour 
of Sn is described by a non-degenerate Wiener process, or the support of the 
distribution of matrices (P, Q, R) belongs to an algebraic manifold defined by 
equations (jl.Sp . 

To make these statements precise we first recall one of the definitions of the 
invariance principle associated with a general random sequence Sn = X]fe=i /fei 
with the convention 5*0 = 0. Let {C[0, 1], ;B, Pi^} be the probability space 
where C[0, 1] is the space of continuous functions with the sup norm topology, 
B being the Borel cr-algebra generated by open sets in C[0, 1], and Pw the 
Wiener measure. Define for t € [0,1] a sequence of random functions Vn(t) 
associated with the sequence Sn- Namely, put 

Vnit)=^n-^Sk + fk+i{tn-k)) iffc<in<fc + l. A: = 0, 1, n - 1. (2.17) 

For a (7 > let {¥„} be the sequence of probability measures on {C[0, l],^} 
determined by the distribution of { <T^^w„(t), < t < 1 }. 

Definition. A random sequence Sn satisfies the invariance principle with pa- 
rameter (T > if PJ^ — > Pw weakly as n ^ oo. If the sequence Sn depends 
on (another) parameter, e.g. zi, then we say that Sn satisfies the invariance 
principle with parameter cr > uniformly in zi if for any continuous functional 
on f : C[0, 1] 1-^ M one has: E5^(f) Ew{^) uniformly in zi as n ^ oo. Here E„ 
and Ew are expectations with respect to the relevant probabilities. 

Let us state the invariance principle for the sequence Sn given by (|2.16|) . 
Note that in this case 

n 

Sn = ^(log||Bfca;fc|| - A), where Xk = \\Bk-iXk-i\\~'^ Bk-iXk-i, k>2. 
fe=i 

(2.18) 

Put Zn = {tpmXn) and /„ = f{gn,Zn), where the function / is defined on the 
set of pairs (5, z) = {{P, Q, R), {tp, x)) by 

fig, z) 1^' log II (/ - P - Qi^r^QxW - A. (2.19) 

Obviously in these notations 5„ = X]fc=i fk- Denote by 2t the Markov operator 
associated with the Markov chain Zn+i = Qn-Zn defined by (j2.6p : if P is a 
function defined on the state space j7o x M of this chain then 

(2tP)(5,z)'= / F{g\g.zMdg'). 

Using these notations we write v{dz) (rather than v{d{^,x))) for the invariant 
measure of the chain z„ and we denote by Mq C M the support of v{dz). 
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Theorem 6 Suppose that condition C is satisfied and the function f is defined 
by (MSI- Then: 

(i) The equation 

F(g,z)-{^F)[g,z) = f{g,z) (2.20) 
has a unique solution F{g, z) which is continuous on Jq x Mq and 

F{g,z)fi{dg)iy{dz) = 0. 

JoX-M 

Denote by 

a'= [ {%F^ - (2[i^)')(ff, yMdg)v{dy) 

(ii) If (7 > then converges in law towards the standard Gaussian dis- 
tribution N{0, 1) and the sequence Sn satisfies the invariance principle with 
parameter a uniformly in {ipi,xi) G M. 

(Hi) If a = 0, then the function F{g,y) depends only on y and for every {g,y) G 
j7o X Mq one has 

f{g.y)^F{y)~F{g.y). (2.21) 
(iv) If a ~ and A = then 

Jo C Jal, (2.22) 

with Jal given by U.8\) . 

Proof. Statements (i), (ii), and (iii) of our Theorem follow from Theorem 
[T^ In order to be able to apply Theorem [T^ we have to show that the sequence 
of random transformations (/„ has the so called contraction property. Lemma 
m establishes this property. Relation (|2.22p is then derived from (|2.2ip and one 
more general property of Markov chains generated by products of contracting 
transformations (Lemma [S]). 

Lemma 6 Suppose that condition C is satisfied and let 

{lpn+l,Xn+l) ^ 9n-{lpn,Xn), ("0^+1 , X^+i ) = g„ . (t/-^ , ) , n>l, 

be two sequences from M. Then there is a c, < c < 1, such that for any 

(V-i.xi), (V'i,x'i)eM 

p((V'„,x„),(V';,0) < const c", (2.23) 

where p{-, ■) is defined by \2.^) . 

Proof of Lemma [HI We shall first prove that there is a cq < 1 such that 
||'0n ~ ^nll 1^ const Cq. Thc control of the a;-component would then follow from 
this result. 

Let us introduce a sequence of m x m matrices i^n, n > \, which we define 
recursively: (pi = and 

(/?„+! = (/ - Rn - QnVnr^Pn. if n > 1. (2.24) 

Remark. Matrices Lpn and i/'n were defined in a purely analytic way. Their 
probabilistic meaning is well known (see [T]) and shall also be discussed in 
Section [3l 

Put Afc = ipk — Vk- To control the i/^-part of the sequence (?/'«, Xn) we need 
the following 
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Lemma 7 Suppose that condition C is satisfied. Then there is a cq, < cq < 1, 
such that for any stochastic matrix -01 G ^' the matrix elements of the corre- 
sponding A„+i are of the following form: 

A„+i(j, j) = a„(i)c„(j) +e„(i, j). (2.25) 

Here a„(i) and c„(j) depend only on the sequence {Pj, Qj, Rj), 1 < J < n; 

the matrix in = (e„(i,j)) is a function of ipi and of the sequence {Pj,Qj,Rj), 

1 < J < f^, satisfying ||e„|| < CiCq for some constant Ci. 

Corollary. If Condition C holds then 

||0„+i-^;+i|| <2CicS. (2.26) 

Proof of Corollary. Consider a sequence ipl^ which differs from V'n in that the 

starting value for recursion p.6p is Put AJ, '= V'fc ~ V^fc. Applying the result 
of Lemma [7] to A^^^ we obtain: 

K+iii,j)^anii)cn{j) + ~e'nihj)- (2.27) 

It follows from (|2.25p . (|2.27p . and the definition of A„+i and A^^^ that | \ipn+i — 
= ||A„+i - A;+i|| < ||e~„|| + He- II < 2Ci c^. □ 

Proof of Lemma[71 The main idea of this proof is the same as that of the proof 
of Theorem 1 from Ij] . A very minor difference is that here we have to control 
the behaviour of ■(/;„ when n is growing while ■01 is fixed; in [T] n was fixed while 
the starting point of the chain was tending to — oo. A more important difference 
is that here we state the exponential speed of convergence of certain sequences 
and present the corresponding quantities in a relatively explicit way while in [T] 
the speed of convergence was not very essential (even though the exponential 
character of convergence had been clear already then) . 
To start, note that it follows from ((2?6l) and (12.2411 that 

A„+i = ((/ - i?„ - Q„V«)"^ -{I-Rn- QnV>ny^)Pn 

= (/ - Rn ~ Q„tJjny^Qn\iiI - Rn - Qn^nY^ Pn = J5„A„(^„+i 

(2.28) 

Iterating ()2.28p . we obtain 

A„+i = B„...SiAi(^2---¥'n+l = Bn.-.Bi'\jjiLp2---Vn+l- (2.29) 

It follows from Lemma |4] that < 1. The matrix elements of the matrices 
(/3„, n > 2, are strictly positive and, moreover, according to estimates (|2.2p we 
have: ipn{i,j) > £ (and hence also ipn(i,j) < 1 — (m— 1)£). We are in a position 
to apply to the product of matrices ipn the presentation derived in Lemma [TKl 
(with a„'s replaced by (^„'s). By the first formula in (|4.16p . we have: 

'P2---'/f„+i £)„[(c„(l)l, . . . , c„(m)l) + 0„], 

where -D„ is a diagonal matrix, c„(j) > 6 with X]j=iCn(j) = 1, and |j0n|| < 
(1 — TO(5)"^^ with (5 > (and of course mS < 1). One can easily see that 
S > m^^e^ (this follows from (|4.15p and the above estimates for ipn{i,j)). We 
note also that the estimate for c„(j) follows from (|4.17p and (|4.18p . 
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dcf 

Put Co = 1 — mS and let S„ = i?„...i3i Ai£)„. We then have 

A„+i = 6„[(c„(l)l, . . . , c„(m)l) + 0„] (2.30) 

and thus A„+i(i,j) = c„(j) S„(i, fc)(l + But allS„(i,A:) > and 

maxfcj- |(/)„(fc, j)|c^^(j) < const Cq. Hence 

-T 7— T = — 7TT +e«(«,J,<)> (2-31) 

A„+i(i,j) c„(j) 

where |e„(i, j, ^)| < Ccq with C bemg some constant. It follows from (j2.3ip that 

m ^ 

(A„+i(i, j))"^^ A„+i(i,0 = — — + e„(i,j). 

1=1 ^''^^> 

On the other hand remember that 



^ A„+i(i,Z) = ^ V'„+i(i,0 - ^(^„+i(i,Z) = 1 - X! y^n+iiij) =^ an(i)- 



dct 

1=1 1=1 1=1 1 = 1 

Comparing these two expressions we obtain that 

^n+i{i,j) = an{i)cn{j) +e„(i, j), (2.32) 

where |e„(i,j)| < CiCq. Lemma[l]is proved. □ 

We now turn to the difference ||x„+i — Let us denote by &„ the 

transformation of the set X of unit non-negative vectors defined by 

bn{x) = \ \BnX\\~'^BnX, whcrC Bn = (/ - Rn - Qn'4'n)~^Qn, (2.33) 

and ipn are the same as above. The sequence b'^ is defined in a similar way with 
the only difference that ipn is replaced by 4'n ■ Inequality (|2.26p implies that for 
some C2 

P{bn,bn) sup||6„(a;) - b'^{x)\\ < CscJJ. 

A very general and simple Lemma from Appendix now implies that 

\\xn+i - < C(e)(co + e)"(l + \\xi - x[\\) 

and this proves Lemma [6l □ 

We can now easily prove the existence of the limit in (|2.12p as well as the 
Furstenberg's formula (|2.13p for A. To this end note that 



5„(Ci,l) ='log||A„...Ai||=log||A„...Ail||-^/(5fc,z,) (2.34) 

k=l 



where the notation is chosen so that to emphasize the dependence of the sum 
SniCi^ 1) on initial values xi = 1 and ipi = of the Markov chain. (Remark 
the difference between 5'„(Ci,l) and the sum Sn in (|2.16p .) Lemma [S] implies 
that 

\Sn{ClA)-Sn{i'l,Xi)\<C3, (2.35) 
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where the constant C3 depends only on the parameter e from condition C. 
But then, according to the law of large numbers applied to the Markov chain 
(wnj QmUn) = {g-n, Cm 2/") defined in Theorem |3] we have that the following limit 
exists with probability 1: 

lim -logP„...^i|| = lim ^^^.(Ci,^!) = A, 

n — ^oo n n — >oo Ji 

where A is given by (|2.13p . 

Formula (|2.13p implies that the mean value of the function /(g, z) defined 
by ()2.19p is 0. Also, it is obvious that this function is Lipschitz on j7o x M in 
all variables. Hence, Theorem [12] applies to the sequence S'„ and statements (i), 
(ii), and (iii) of Theorem [6] are thus proved. 

The case cr = and A = 0: derivation of the algebraic condition for 

{P,Q,R). We start with a statement which is a corollary of a very general 
property proved in Lemma [T51 from Appendix. 

Lemma 8 Suppose that Condition C is satisfied and let g € Jq, Zg d M be 
such that g.Zg = Zg. Then Zg € Mq = supp;^. 

Proof. According to Lemma [6l Condition C implies that every 5 G j7o is 
contracting. Hence, by Lemma [T3l Zg £ Mq. □ 

Derivation of the algebraic condition. According to Theorem[T2](see formula 
(|4.10p '). the equality a — implies that f{g, z) = F{z) — F{g.z). Hence, if z can 
be chosen to be equal to Zg, then it follows that f{g,Zg) — 0. 

In the context of the present Theorem the function / is given by f{g, z) = 
\og\\{I-R-Qip)-'^Qx\\, where g = {P,Q,R) € Joandz = {ij},x) € Mq C *xX. 
The equation g.Zg ~ Zg is equivalent to saying that Zg = [ip, x) satisfies 

{I - R-Qipy^ijj = ijj and \\{I - R - Qi;)~^Qx\\-\l - R - Qipy^Qx ^ x. 

The equation f{g, Zg) — now reads log ||(/ — i? — Q'il))^^Qx\\ — or, equiva- 
lently, ||(/ — i? — Q'il))^^Qx\ \ — 1. Hence the conditions a — Q and A = imply 
that all pairs (g, Zg) E Jq x Mq satisfy 

{I - R-Qipy^P = and {I - R- Qi{j)-^Qx = x. 

But, by Lemma [SI this implies that Jq C Jai, where Jai is defined by p.Sp . □ 

3 Proof of Theorem [1] 

As we are in the recurrent situation, we have that the Lyapunov exponent A = 0. 

Throughout this section we denote by C a generic positive constant which 
depends on nothing but e and m and which may vary from place to place. If 
f,g>0 are two functions, depending on n G Z, i G {1, . . . , m}, and maybe on 
other parameters, we write 

/ X g if there exists a C > 1 such that C^^/ < g < Cf 

Potential and its properties. As before, Sn is defined by ()2.16p . We put 

r iog||A„...^iii if n> 1 

= $„ = \ if n - (3.1) 

[ -log||Ao...A„+i|| ifn<-l 
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where the matrices An are defined in (|2.10p . li n > 1, then obviously = 
SniCij 1) defined in (|2.34p . The random function <i>„ is the analog of the poten- 
tial considered first in ,,18] . For n > a, a € Z, put 

Sa^n{(^;'ipa,Xa) = 5a,„(t^) =^ log|lB„ . . . BaXa\\ , (3.2) 

where the matrices Bn are defined by (|2.7p . Similarly to (|2.35p . one has that 

|'S'a,n(w;Ca,l) " Sa,nioj; ^Ja, Xa)\ < C, (3.3) 

which implies: 

\Sa,n{^)-i^n{L^)~^a{L^))\<C. (3.4) 

Since one of the conditions of Theorem[T]is Jo ^ Jai , it follows from Theorem 
ini part (iv) that satisfies the invariance principle with a strictly positive 
parameter a : a > 0. 

The importance of the potential {^7i}nez ^^"^ ^o that fact that it governs 
the stationary measure of our Markov chain; in fact it defines this stationary 
measure up to a multiplication by a bounded function (see (|3.7p . Namely, if 

a < b, we consider the Markov chain I > on 

I * JtGN 

{a,...,5} X {l,...,m} (3.5) 

with transition probabilities (II. 4p and reflecting boundary conditions at La and 
Lb. This means that we replace {Pa,Qa, Ra) by (7,0,0) and {Pb,Qb, Rb) by 
(0, /, 0). This reflecting chain has a unique stationary probability measure which 
we denote by na^b = (t^uM {k, j^gg ^ ■ ^ description of this measure was given 
in [1]. We repeat it here for the convenience of the reader. To this end introduce 

row vectors Vk '= Z {na^b {k,i))^^^^^, a < k < b, and Z is a (normalizing) 
factor. In terms of these vectors the invariant measure equation reads 

Vk^i^k-iPk-i+i^kRk + Vk+iQk+i, if a<k<b 

(3.6) 

l^a — ^a+lQa+l, t^b — ^b-lPb-l- 

To solve equations p.6p . deflne for a < k < b matrices ak by 

tta =^ Qa+i, and Ok =^ Qk+i {I - Rk- Qki^k)'^ , when a <k <b, 

where {i^k}k>a+i ^'"^ given by (|2.6p with the initial condition V'a+i = I (we 
take into account that Ra — Qa = in our case). We shall now check that 
Vk can be found recursively as follows: Vk=Vk+iOiki a < k < b,, where Vb 
satisfies iyb'4'b — i^b- Indeed, the boundary condition at b in p.6p reduces to 
Vb = VbCXb-iPb-i = Vbtpb, where we use the fact that ab-iPb-i = "06 because 
Qb — I (and also due to (|2.6p ). But -tpb is an irreducible stochastic matrix 
and therefore Vb > Q exists and is uniquely defined up to a multiplication by a 
constant. We now have ior a < k <b that 

Vk~iPk-i + VkRk + Vk+iQk+i = Vk+i (akCtk-iPk-i + OikRk + Qk+i) 

= Vk+iUk {Qkipk + Rk + (I - Rk - Qkipk)) 
= Vk+iak = Vk- 
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Finally Va = i^a+iQa+i with Ua = Qa+i and this finishes the proof of our 
statement. 

We now have that 

where as before 'na,b {k, •) is a row vector. Note next that 

ab-iab-2 a/c = Bb-i Sfc+i {I ~ Rk - QkipkY^ ■ 

From this, we get 

TTa.b (fc, •) ^ \\Bb-l Bk+i\\ TTa,b ') , 

and using (|3.2p . (|3.4p . we obtain for a < k,l < b 

^^^xexp (3.7) 

We also consider the "mirror situation" by defining for n < a the martices 
in a similar way as in (12. 6|) by setting 



dcf 



and a boundary condition ip^ . Then, as in Theorem |4] a) , one has that — 
lima^oo ipn exists almost surely, and does not depend on the boundary condition 
ip~ . We then put 

and the potential $^ as p. II) : 



log||Ao...A-_i|| if n>l 
= <! if n ^ 

-log\\A-...AZ,\\ ifn<-l 

We could as well have worked with this potential, and therefore we obtain 

^ ( - exp - $ J . 

As $0 = $^ = 0, we get 

\'i>n-K\<C (3.8) 

uniformly in n. 

It is convenient to slightly reformulate the invariance principle for the po- 
tential. For that consider Cq (— oo, co) , the space of continuous functions / : 
(—00,00) R satisfying / (0) = 0. We equip Co (—00,00) with a metric for 
uniform convergence on compacta, e.g. 

C30 

d if, 9) '^'^ [l- sup,e[-fe,fc] 1/ (a;) - <? (a;)|] , (3.9) 

k=\ 

and write B for the Borel-cr-field which is also the cr-field generated by the 
evaluation mappings Co (—00,00) — > M. We also write Pw for the law of the 
double-sided Wiener measure on Cq (—00, 00) . 
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For n e N, we define 

y n J yjn 

and define Wn (i) , i G M, by linear interpolation. Wn is a random variable 
taking values in Co (—00, 00) . 

Weak convergence of {Wn (OlteR ^0 (^co, 00) is the same as weak con- 
vergence of {yVn (i)}te[_jv,jv] ^"^y G N, and therefore, we immediately 
get 

Proposition 7 Wn converges in law to Pw- 

Let V be the subset of functions f & Co (—00, 00) for which there exist real 
numbers a <b < c satisfying 



1. 



2. 



3. 



e (a, c) . 

/(a)-/(6) = /(c)-/(6) = l 

/(a) >/(a;) >/(6), Vxe (a,6), 
/(c) >/(a;) >/(6), Vxe (6,c). 



4. For any 7 > 



sup / (x) > f (a) , 

ccG(a— 7,a) 

sup f{x)> f (c) . 

x6(c,c+7) 

It is clear that for / G V, a, 6, c are uniquely defined by /, and we write 
occasionally a (/) , 6 (/) , c (/). / (6) is the unique minimum of / in [a, c] . It is 
easy to prove that V G B, and 

Pw {V) = 1. 

If (5 > and / e V^, we define 

C5 {f) = M{x>c:f{x) = f{c)+d} 
as if) =^ sup {x < o : / (x) = / (o) + 5} 
If 7 > 0, we set Va^-y to be the set of functions f gV such that 
1. 

cs if) < 1/8, as if) > -1/(5. (3.10) 
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2. 



3. 



sup [fix)-f{y)]<l-S, (3.11) 

b<.x<y<.C5 

sup [fix)~fiy)]<l-S. (3.12) 

<y<a:<6 



^ mf ^ /(x) >/(&) + (5. (3.13) 



It is evident that for any 7 > 0, we have Vs^-y t V for <5 i 0, and therefore, 
for any 5, 77 > we can find (7i ??) such that for 5 < 60 

Pw (^5.7) > 1 - ^■ 

It is easy to see that 

Pw {dVs^^) = 0, 

where d refers to the boundary in Co (—00,00) . Therefore, given 7,77 > 0, we 
can find A'o (7, rj) such that for n > Nq, S < 60, we have 

P (W^„ e 14,^) > 1 - 2ry. (3.14) 

For t e N, we set n — n(t) [log^ t\ . If Wn(t) G V^^-y then we put 

, dof b (VF„(t)) log^ t dof 05 {W„(^t)) log^ ^ dof ca (W^„(t)) log^ t 

0* — 3 , at — 5 , C( — r . 

cr^ cr^ cr^ 

Remark that on {iVn(t) G ^5,7} 7 we have the foUowing properties, translated 
from ([3l0l) - ([3l3l) : 

log^t log't 

- < (1 - ^) logi, bt<s<s' < ct, (3.16) 
$s - < (1 - ^) logt, at < s' < s < (3.17) 

> +(5fogt, sG [at,ct]\ [&t-7log'i,^'t+7log'i] , (3.18) 
min ($,„ - > (l + <5)fogt. (3.19) 
Furthermore, if G [at, bt] , then 

sup -$b, <logt, (3.20) 

0<s<bt 

and similarly if G [bt , ct] . 

(We neglect the trivial issue that at,bt, Ct may not be in Z). The main result 

is 

Proposition 8 For uj G {W„(t) G V^.^} , we have for any i G {1, . . . , m} 

Pr^Xo,^) {X it) i[bt-l log' tM+1 log' t] ) < 4t-'/^, 
if t is large enough. 
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Together with p.l4p . this proves our main result Theorem [T] 

In all what follows, we keep 7, S fixed, and assume that oj G {Wn(t) G ^^,7} ■ 

We will also suppress lu in the notation, and will take t large enough, according 

to ensuing necessities. 

We first prove several estimates of probabilities characterizing the behaviour 

of a RW in a finite box in terms of the properties of the function Sn- 

Lemma 9 Consider a random walk on Sa,b with reflecting boundary conditions 
(see the discussion around i3.5]) ). and let a < k < b. Then 

b 

Pr(k,^) (Ta <n)<CY, exp {<^y " $a) , (3.21) 

y=k 
k 

Pr^kA in <Ta)<Cj2 exp - ^a) . (3.22) 
Here Ta, are the hitting times of the layers La, Lh. 

Proof. We only have to prove (|3.2ip . p.22p then follows in the mirrored 
situation and using (jS.Sp . 

Put hk{i) — Pr^k.i) [Tb < Ta) and consider column- vectors hfc {hk{i))i<i<w. 

In order to find hfe we introduce the matrices ffk+i {'4^k+i{i, i))i<i.j<m, were 

V>k+i{i,i) =^ Pr^.(kA (■^fc+i < i{Tk+i) = (fc + 1, j)) . (3.23) 

These matrices satisfy (I2.24p (with a = 0) with the modified boundary condition 
Va+i = 0. The equation (|2.29p with ij^kH defined by (|2.6p now yields A^+i — 
Bk...Ba+ii^a+i'Pa+2---^k+i and hence 

||Afc+i|| < \\Bu...Ba\\ < Cexp($fe - $,) (3.24) 

The Markov property also implies that = ipk+ihk+i and hence 

^ ^Pk+i^k+2 ■ ■ ■ Vbi since hb = 1. (3.25) 

We view the probabilities Pr(^k.-) i^a < n) as the column vector 1 — h^. Then, 
presenting (^b = -06 — Ab, we can have 

P^ik,-) {Ta < n) = 1 - ipk ■ . ■ ifib-il = 1 - ^k+1 ■ ■ ■ Vfc-i('/'6 - Ab)l 

= 1 - ^k+1 ■ ■ ■ Vb-ll + Vk+1 ■ ■ ■ (ySb-lAbl 
< 1 - ipk+1 ■ ■ . ^b-l^ + IIAblll. 

Iterating this inequality, we obtain that 

b 

y=k+l 

and ((X^ follows from (fX^ . □ 
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Lemma 10 Let a < b, and r be the hitting time of LaU Li, ~ the union of two 
layers. Then if a < k < b, we have 



Eik,^) (r) < C{b-af exp 



min ( sup (<i> (s) - $ (i)) , sup (<i> (t) - $ (s)) 

a<s<t<b a<s<t<b 



Proof. To prove that, consider column-vectors — ^^t) These 
vectors satisfy ea = ei, = 0, and for a < k < b : 



efc = Pkek+i + RkGk + QkGk-i + 1 



(3.26) 



To solve (j3.26|) , we use an induction procedure which allows us to find a sequence 
of matrices ipk and vectors dfc such that 



efe = Lpk+iGk+i + dfc. 



(3.27) 



Namely, we put fa+i = 0, da = which according to p.27p implies that 
— 0. Suppose next that ipk and dfc_i are defined for some k > a + 1. Then 
substituting e^-i = ipk^k + dk^i into the main equation in (|3.26p we have 



Gfc = PfcGfc+i + RkBk + Qki^PkGk + dfc_i) + 1 



and hence 



efc = (/ - Qk^Pk ~ Rk) ^ (Pkek+i + Qkdk-i + 1) 
which makes it natural to put 

(fik+i = (/ - Qk^k - RkY^Pk 

and 



where 



dfc = Bfc((pfc)dfc_i + Ufc, 



Uk ^ {I - Qkfk - Rk) ^1, Bk{(pk) ^ {I ~ Qk^Pk ~ Rk) ^Qk- 



(3.28) 
(3.29) 



The existence of matrices ipk follows from the fact that <y9fc > and <y9fcl < 1. 
Iterating (PTTT]) and ([g^ we obtain 



and 



Hence 



efc = dfc + ifk+idk+i + ... + (pk+i-.-fb^idb-i 



dfc = Ufc + Bfc((^fc)Ufc_i + ... + Bk{ipk)---Ba+liiPa+l)Ua. 



||d6_i||<C(6-A;) max ||d,| 

k<j<b—l 



llefcll < ||dfc|| + ||dfc+i|| + .. 
But \\Bkiipk)--Biiipi)\\ < Csupa<3<t<f,exp($(s) - $ (i)) and therefore 
Eik,^) (t) < C{b - a)2 exp sup ($ (s) - $ (<)) 

la<s<t<b 



We obtain the same estimate with $ replaced by $ , and using 
get the desired estimate. □ 



we 
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Lemma 11 Let a < k < b and ^(t) be as in Lemma\^ Then for any a; > 

Pr(k.t) in >x, Tb< Ta) < ^ °^ exp [sup„<^<t<f, ($ (t) - $ (s))] . 
Proof. Let again r being the hitting time of LaU Li,. It is obvious that 

Pr{k,i) in >x, n <Ta) < Pri^ks) (t > x) . 
By the Markov inequahty and Lemma [TUl the resuh foUows. □ 

Lemma 12 Let a < b, and consider the chain {^t} on ^a,b with reflecting bound- 
ary conditions on a,b, as above. Then for any t € N, {k,i), & Sa,b, we 
have 

Proof. 

T^a,b{l,j) = ^ T^a.bik' ,i')Pr(k'a'){it^ {l.j)) 
(k'a') 

> TTa,b{k,i) Pr(^k,i) (6 = 

for all {k,i) , G Sa.b, and all t eN. The Lemma now follows with (I3.7p . □ 

We have now all the ingredients for the 
Proof of Proposition [8] 

We may assume that G {at, bt]. The case of € (&t, q) is handled similarly. 
We will write a,b,c for at,bt,ct, to simplify notations. We write Jt for the 
interval [6 — 7 log^ t,b + j log^ t] 

We have 

Pr(o,,) {X {t) i Jt) < Pr(o.,) {X {t) ^ Jt, n < min (ra, t)) + Prjo,,) {n > Ta) 

(3.30) 

+ Pf'{o,i) in > t,Ta> n) 

First we see that from Lemma 13 and ^JE^, ^J^, 



P'>^(o,i) in> n) <C ib- a) exp 



sup $^ - $Q 

0<2;<6 

<^i^expMlogi]<rV2^ 



(3.31) 



if t is large enough, and from Lemma [Til and p.l7p 

Prio,^) in >t,Ta> n) < exp [sup„<,<,<, ($ (<) - $ (s))] (3.32) 

<£l^exp[(l-^)logt]<t-*/2. 

By the Markov property, we get 

Pr(o,o(X(t)^ Jt,Tb< min (ra,t))< max Pr^k,j) iX is) ^ Jt) . (3.33) 

s<t,l<j<rii 
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Now 

Pr(b,,) {X (s) i Jt) < Pr^bj) (mill (t<„t,) < t) + Pr^,^^) (x^"'^) (s) ^ J*) , 

(3.34) 

where X'^"''^^ is the chain with reflecting boundary conditions at La and Lc- The 
second summand is estimated by Lemma [T2] and p.lSp . which give 

< cr* < r^^^. (3.35) 

To estimate the first summand in (|3.34p we observe that by p.l9p 

Pr{b-l,^) {Ta < n) < Cexp [-$a] (cxp [$f,_i] + cxp [$,,]) < C cxp [- (1 + 5) \ogt] 

^-1-25/3 

and similarly 

If, starting in {b,j) , the chain reaches La or Lc in time t, there is at least one 
among the first t/2 of the excursions from Lb which reaches La U Lc- By the 
above estimates, each such excursion has at most probability ^-1-2)5/3 
"successful" , and therefore 

Pri^bj) (min (T„,Te) < t) < 1 - (^l - ^-1-2^/3^^' < ^-5/2^ (3 gg^ 

Combining ([S3ni)-(IS3SI), we get 

^^(0,*) {X it) i Jt) < 4t-^/2. 

This proves the claim. 

4 Appendix 

Most (if not all) of the results in this Appendix arc not new. The main reason for 
including them is that we want to present them in the form which is needed for 
our purpose; this is particularly relevant in the case of Markov chains generated 
by contracting transformations. We also hope that a more self-contained paper 
makes an easier reading. 

4.1 The CLT and the invariance principle (IP) for sta- 
tionary Markov chains. 

We first recall, in subsection l4.1.H the classical results of B. M. Brown 2J about 
the CLT and the IP for martingales. We then explain in subsection 14.1.21 that 
the reduction of the proof of the CLT for Markov chains to the martingale case 
invented by Gordin and Lifshits [TD] can be easily extended to obtain the IP for 
Markov chains. Finally, in subsection 14.1.31 we prove that the Gordin-Lifshits 
conditions are satisfied for a class of Markov chains generated by contracting 
transformations . 



Pr 



(6,,) {s)^Jt) <Cexp 



sup$z 
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4.1.1 The CLT and the IP for martingales (by B. M. Brown [2]). 



Let { Sn, Tn }, n = 1, 2, ... be a martingale on the probability space (fi, T , P). 
Put Un = Sn — Sn-i With 5*0 = 0. The expectation with respect to P is denoted 
by E, and stands for the conditional expectation E(- | Let cr^ = 

E„_i(t/2), = J2"=i and s\ = E(y„2) = ^{Sl). The main assumption in 
[2] concerned with martingales is: 

^n^n'^ ~^ 1 probability as n oo. (4-1) 

We says that the Lindeberg condition holds for the class of martingales satisfying 
(|4.ip if for any e > 

n 

s~2^E[/2j(-|^^.| > gg^j ^ asn->oo, (4.2) 

where /(•) is a characteristic function of a set. 

For t Cz [0,1] define a sequence of piecewise linear random functions 

Unit) = {Sk + Uk+l{tsl - -sDisl^, - 4)-l) 

if4<^4<4+i, A;-0,l,...,n-l. 

The following two theorems from [2] describe the asymptotic behaviour of the 
sequences Sn and «„(•). 

Theorem 9 // and /loZrf, i/ien S'„ is asymptotically normal: 

/X 
e-^y'dy (4.4) 
-oo 

/or aZZ X. Furthermore, all finite dimensional distributions of Un{t) converge 
weakly, as n ^ oo, to those of a standard Wiener process W{t) on < t < 1 
(that is W{0) = and EW^{1) = I). 

Theorem 10 Let { C[0, 1],B, Pw } be the probability space where C[0, 1] is the 
space of continuous functions with the sup norm topology, B being the Borel 
a-algebra generated by open sets in C[0, 1], and P\y the Wiener measure. Let 
{P„} be the sequence of probability measures on {C[0,1],B} determined by the 
distribution o/{u„(t), < t < 1}. Then if (^TTp '^^'^ l^.^j ) hold, P„ Pw 
weakly as n ^ oo. 



4.1.2 The CLT and the IP for general Markov chains. 

In their famous work [T^ , Gordin and Lifshits reduced the proof of the CLT for 
Markov chains to that of martingales. They then applied the same approach to 
the proof of the invariancc principle for Markov chains in [TT] . We shall explain 
their method here for the sake of completeness. 

Let Zfc, fc = 1, 2, be a stationary ergodic Markov chain with a phase space 
{X,A), transition kernel K{z,dy), and initial distribution k. Let / : X i-^- R 
be a real valued function on X such that E/(z) = and Var/(2;) < oo (all 
expectations are taken with respect to the measure k). Let L2(X, k) be the 
natural Hilbert space associated with X, A, k. By I we denote the identity 
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operator in this space, and by 21 the transition operator of the Markov chain: 
^F{z)^:^' J^Fiy)K{z,dy). Put 

Sn — f{zi) + ••• + f{zn) with the convention 5*0 = 0. (4-5) 

Theorem 11 Let Zk he a Markov chain described above and suppose that the 
function f with Kf — can be presented as f ^ (I — 2l)-F, where F G L2{X, A, k) 
andEF = 0. Put a'^ = pi^||2 = EF'^-E{^Ff and suppose that a > 0. 

Then converges in law towards the standard Gaussian distribution N(0, 1) 
and the sequence Sn satisfies the invariance principle with parameter a in the 
sense of the definition given in Section \2.4\ 

Proof. Consider the identity which is due to Gordin ([H]) and was used 
by Gordin and Lifshits in (TU]: f{zk) — U{zk, Zk+i) + F{zk) — F{zk+i), where 
U{zk, Zk+i) — F{zk+i) — (2lF)(zfc). This identity holds true because of the 
conditions imposed on /. Obviously, E{U{zk, Zk+i) \ Zk, zi} = 0. Denote 
Uk+i = U{zk, 2fc+i)- In these notations we can write 

Sn = Sn + F{zi) - F(z„+i), where Sn = J2k=i ^k- 

It is clear that if J-n is a ct- algebra generated by the variables zi, ...,z„, then 
the sequence Sn, n — 1,2, .. is a martingale with respect to the filtration Tm 
n — 1,2,.... Let us check that all conditions required by Theorems [9l and fTOl 
are satisfied. Indeed, crj = E{f7| | Zj} = (2lF^)(zj) - [{%F){zj)Y is a stationary 
sequence with Ect| = - ||2li^|p = cr^. Relation (|i?T|) takes the form 

n 

and is satisfied with probability 1 because of the Birkhoff Ergodic Theorem. 
The Lindeberg condition ()4.2|) takes the form 

E[/f > encr^) ^ as n ^ oo, 

and is obviously satisfied. Finally, functions (|4.3p are now given by 

u„(t) = n^^cr"^ + (tn - fc)C/fe+i) iik <tn <k + l, fc = 0, 1, n - 1 
and hence for k < tn < k -\- 1 

Vn{t) = Unit) + n^^a-^ (F(zi) - F{zk+i) + {tn - k){F{zk) - F{zk+i))) , 

where Vn{t) is as in (12.17p . Since F is square integrable and z„ is a stationary 
sequence, it follows that n^^ maxi<fc<„ |i<"(zfe)| — > with probability 1 as n — > 
oo. Hence also the supg<;(<]^ \vn{t) — 'u,n{i)\ — > as n — > cxd with probability 1. 
All statements of our Theorem follow now from Theorems |9] and [TOl □ 

4.1.3 The CLT and the IP for Markov chains generated by contract- 
ing transformations. 

Consider the following setup. 

(Jl, J^, P) is a probability space; the related expectation is denoted E. 
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M is a compact metric space equipped with a distance •). 

*B is a semigroup of continuous Lipschitz transformations of M: for any 
5 G 05 there is a constant Ig such that p{g-y, g.y') < lgp{y, y') for any y, y' S M. 
Here and in the sequel g.y denotes the result of the action of g G 5B on y e M; 
this notation will be used most of the time but in some cases we may write g{y) 
rather than g.y. 

For any gi, 52 e S put ^(51,32) =^ supy^^ p{gi.y, g2.y). Obviously, p{-,-) 
defines a distance on 05. We can now consider a Borel sigma-algebra generated 
by the corresponding open subsets of 03; this sigma-algebra will be denoted by 
6. 

Consider a measurable mapping g : 05, uj 1-^ g'^ and for a _B e S put 
p{B) =^ ¥{uj : g'^ G B}. We say that 5 is a random transformation of M. 
Let (7fe G 05, /c > 1 be a sequence if independent copies of g. Without loss 
of generality we can assume that gk are defined on the same probability space 

Denote by g'^' = gj . . .gi the product of random transformations gi, ...,gj 
and let p^^^ be the probability distribution of the product q'^^K This measure 
on 05 is often called the j'^ convolution power of the measure p and is denoted 
by /i^^^ = p*^ = p * . . . * p {j times). 

A sequence of random transformations gk is said to be contracting if there 
are constants C > and c, < c < 1 such that for any y, y' £ M and any n > 1 

[ p{g.y,g.y')p^"Hdg)=M9n---gi-y,gn...gi.y')<Cc''. (4.6) 

J'B 

Remark. Perhaps it would be more natural to say that the contraction property 
holds if p{g.y,g.y')p^"^\dg) < Cc^ p{y,y'). However, (|4.6p is sufficient for our 
purposes and is what we check in our applications. 

As usual, products of random transformations generate a Markov chain with 
a state space M. Namely, let v = v{dy) be a probability measure on M and let 
?/i S M be chosen randomly according to the distribution v and independent of 

all ffj's. For fc > 1 define yu+i G M by yu+i =^ gu-yk = s'^'^^-yi- The sequence 
of pairs {gk, yk), k > 1 forms a Markov chain with a phase space 05 x M; this 
chain will be denoted (g,y). Note that the (y)-component of this chain, the 
sequences yk, fc > 1, is itself a Markov chain with the phase space M. Since 
M is a compact space the chain (y) has an invariant measure; we shall suppose 
from now on that v is such a measure which, in turn, implies that p{dg)v{dy) 
is an invariant measure of the chain (g, y) . It is well known (and easy to see) 
that if gk is a contracting sequence of random transformations then the Markov 
chain (y) has a unique invariant measure. 

Let £2 (05 X M) be the Hilbert space oi p x v square integrable real valued 
functions and C(05 x M) be its subset of continuous functions. 

Given an / G C(S x M) let Sn denote the related Birkhoff sums along a 
trajectory of the Markov chain (g, y): 

n 

Sn = ^f{gk,yk)- 

k=l 

By 21 we denote the following Markov operator acting in £2(S x M) and pre- 
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serving C(QS x M): 



(2t/)(.9,y) = / f{9\g.y)^^{dg'). (4.7) 



It follows from that 



(2lV)(5,y)-/ /(ff',ff<?.2/V(dg')M*'"'^(rf5)- (4.8) 

Theorem 12 Suppose that the sequence of random transformations gu is con- 
tracting and f is a continuous hounded function on 05 x M such that 
(i) f{9Ty)f^{dg) is Lipschitz on M, that is for some Cf 

' {f{9,y)^f(.9,y')Md9)\<Cfpiy,y'), 

(^^) /s fi9,y)tJ'{d9)i^{dy) = 0. 
Then the equation 

{I-m)F = f, (4.9) 
has a solution F{g, y) which is continuous on 03 x M and 

Fig,y),,idgMdy)^0. 

23xM 

Besides, this solution is unique in C2{^ x M). 
Denote by 

a^^ [ {%F^ - {%Ff){g. y)y.{dg)v{dy) 

If a > then converqes in law towards the standard Gaussian distribution 
N{0, 1) and the sequence Sn satisfies the invariance principle with parameter a . 

If a > and, in addition to (i), \ f{g,y)-f{g,y')\ < Cf{g)p{y,y') with J \og{l + 
Cf{g))fi{dg) < oo, then the invariance principle for the sequence 5„ is satisfied 
uniformly m t/i G M. 

Ifa = 0, then the function F{g,y) depends only on y and for every {g,y) in the 
support of fi X 1/ one has 

f{g,y)^F{y)-F{g.y). (4.10) 

Proof. The existence of F. Equation (|4.9p can be rewritten as F = 2li^ + / 
and, iterating this relation, one obtains a formal series: 



F = ^2tV (4.11) 



fc=0 

Condition (ii) of the Theorem and the invariance of the measure fi{dg)i>{dy) 
imply that 

/ {^''f){g,y)fi{dgMdy)= f f{g,y)ti{dgMdy)^0. 

J'SxM J'SxM 
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Hence, the convergence in (|4.1ip would follow if we prove that 



l(2t''/)(ff,y) - (2t''/)(g,2/)| < constc"o for any {g,y), {g,y) e support of /i x j/. 

(4.12) 

But it follows from (|4.8p and condition (i) of the Theorem that 

l(2iV)(5,y)-(2iV)(ff,y)l 

= X (X 55-2/) - fig'rg-g-y)) /^(dff')) m''"'' (^5) 

where the last inequality is due to the contraction property (|4.6|) . The existence 
and continuity of F{g, y) is proved. 

Uniqueness. As usual, to prove the uniqueness we have to show that the 
homogeneous equation F = 21F has only a trivial solution F = in the class of 
functions satisfying the condition J^^j^F(g,y)^(dg)i'{dy) = 0. To check that 
this is the case assume that, to the contrary, there is an S C2{^ x M) such 
that F ^ 0, satisfies the homogeneous equation, and has a zero mean value. For 
a given e > find a function F which is Lipschitz on *B x M and approximates 
F in the sense that ||F — F|| < e, where || • || denotes the £2(S x M) norm. 
The F can always be chosen so that /^^m F{g, y)^{dg)v{dy) = 0. Next, for any 
n>l 

F = 21" = 2t"(i^ ~F)+ 2l"F. 

But then — > uniformly in {g,y) and ||2l"(i^ — F)\\ < e. Since e can be 
made arbitrarily small, we conclude that F = 0. 

Proof of the CLT and the IP in the case ct > 0. According to Theorem 1111 
the existence of e £2(S x M) satisfying equation (|4.9p is the main condition 
under which both the Central Limit Theorem and the Invariance Principle hold 
for Birkhoff sums picked up along a realization of a trajectory of a Markov chain. 
The crgodicity of the Markov chain is the other condition which is needed and 
which in our case follows from the contraction property. The CLT and the IP 
is thus proved. 

Proof of the uniform IP in the case a > 0. We write Sn{yi) for 5„ in order 
to emphasize the dependence of this sequence on yi . Clearly, 

n oo 

\Sn{yi)-Sn{y[)\<Y.\f{gk,yk)-f{gk,y'k)\<Y.^f(9k)p{yk,y'k)- (4.13) 
fc=i fc=i 

It follows from (|4.6p (due to the Chebyshev inequality) that P almost surely 
p{yk,y'k) ^ e"^*^ for some e > and k > k{e,uj). It is essential that k{e,Lu) does 
not depend on yi,y[. Next, due to the condition imposed on the function /, the 
sequence k'^ log(l + Cf{gk)) — > as fc ^ cx3 P almost surely. Hence the right 
hand side of (|4.13p is P almost surely bounded and the corresponding estimate 
does not depend on yi,y'i- 

Let us now consider the dependence on yi of the relevant u„(i) = Vn{t;yi) 
(see (PT7|) '). For t e [0, 1], and k < tn < k + 1, k ^0,1, ...,n- 1 we have: 

vn{t;yi) - vn{t;y[) = n'i {Sk{yi) - Sk{y[) + {fk+i{yi) - fk+i{y'i)){tn - k)) 
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with the obvious meaning of fk+i(jji) and fk+iiui)- It is now clear that P almost 
surely Vn{t;yi) — Vn(t;y[) — > as rt — > cxd uniformly in This proves that 

the uniformity of the invariance principle. 
The case a = 0. Note that 

{^F^ -%{F^)){g,y)^ j^{F{g\g.v)~ j^F{g,g.v)ti{dg)^ fi{dg'). 

Hence cr = implies that for /i x t/-almost all {g, y) and /i-almost all g' 

F{g',g.y)^ f F{~g,g.y)^i{dg). (4.14) 

But F{-, •) is a continuous function of both variables and hence (|4.14p holds for 
any (g, y) from the support of fi x v. This proves that F depends only on the 
second variable: F{g',g.y) = F{g.y) (we note that g.y runs over the whole of 
the support of when {g, y) runs over the support oi ^xv). Finally, one obtains 
by substituting F{y) (rather than F{g,y)) into (g^. □ 

4.1.4 Markov chains generated by contracting transformations: char- 
acterization of the support of the invariant measure. 

The aim of this section is to give a characterization of the support of an invariant 
measure of a Markov chain generated by contracting transformations in terms 
of fixed points of these transformations. 

We work here within the same setup as in section l4.1.3l This applies to the 
sequence gj, j > I, the metric space (M, p), the semigroup 5B of transformations 
of M, the Markov chain yj defined by yj+i — gj-yj, j > 1 (with yi being a 
random element independent of all gj's). However, we shall suppose that 03 is 
generated by the transformations belonging to the support jTo of the distribution 
/i of (7j's. This difference is important for Lemma [Ml 

Let v be the stationary measure of our chain and Mq be the support of v. 

As usual, we say that a transformation € 53 is a contraction on a subset 
Mq C M if there is an n > 1 and a c G [0, 1) (both n and c may depend on g) 
such that p(g".a;',5".a;") < cp{x',gx") for any x' , x" G Mq. If g G 03, then by 
Xg we denote a fixed point of the transformation g: g.Xg = Xg. 

Lemma 13 If g is a contraction on M then its fixed point Xg G M, belongs 
to the support Mq of the invariant measure v of the Markov chain yj . 

Proof. Consider a random infinite sequence gi,g2T... Since g £ JTq, almost 
every such sequence has the property that for any fc > 1 and any 6 > there 
are infinitely many i's such that each element of the part f/^, ...^ gi^^ik—i 

of the 

sequence approximates g so closely that 

P(5"'',0!"''^) < (5 where si"'"^ =^ g^+nk~l■■■g^■ 
Moreover, by the law of large numbers these i's have a positive frequency. Since 

pixg,g-\x') = p{g^^''xg,g-\x') < c^p{xg,x') 
for any x' G M, we have that 

p{xg,Q^^''\x') < c'^pixg,x')+p{g^\x',g^''\x') < c''pixg,x') + S. 
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Hence any (small) neighbourhood of is visited by the sequence of .x' ^ j > 1, 
infinitely many times and, moreover, this happens with a positive frequency 
for almost every sequence gj, j > 1. This implies that Xg € Mq and (g,Xg) S 
Jo X Mo. □ 

Note that if the invariant measure v of our Markov chain is ergodic, then 
the support Mg of this measure is a minimal set of *B. The latter by definition 
means that the orbit {g.x : g g 05} of any x £ Mq is everywhere dense in Mq. 

Lemma 14 Let Mq C M &e a minimal set of 03. Suppose that there exist a 
5 € 5B which is a contraction on Mq. Consider the set of all fixed points of *B 
belonging to Mq; 

FixMo(5B) '= {x : X G Mq and there is a g G ^ such that g.x^x }. 
Then FixMo(05) is everywhere dense in Mq. 

Proof. The contraction g given to us by the condition of the Lemma has a 
fixed point x € Mq (it may have other fixed points too, but we are interested 
only in this one). Since Mq is minimal it coincides with the closure of the orbit 
{g.x : g E *B}. For a given g e *B let us consider the point g.x. We shall now 
show that for a sufficiently large n the transformation gg" has a fixed point 
which we shall denote Xggn . Indeed, for any x' , x" € Mq 

p{99'^-x ,gg"^.x") < lgp{g".x',g".x") < lgc"p{x ,x"). 

If n is such that Igc" < 1, then there is a fixed point Xgg" of gg". On the other 
hand, it is obvious that gg" -x' g.x as n — s- oo uniformly in x' € Mq because 
g" .x' — > X uniformly in x' G Mq. It follows that in particular Xgg^ g.x and 
this proves the Lemma. □ 

4.2 Products of positive matrices. 

Lemma [15] below explains two versions of a well known contraction property of 
products of positive matrices (see, e.g. [S]). The first version of this property has 
already been explained and proved in the Appendix to [T] and we therefore prove 
here only the second version. There is a slight difference in the notations used 
in this paper and those we have introduced in [T] and no difference in the proof; 
we emphasize once again that this is done for the purposes of completeness and 
convenience of references in the proofs of other theorems. 

Lemma 15 Let a„ — {an{i,j)), n — 1,2, ... be a sequence of positive m x m 

def def 

matrices, a„ > 0. Put iJ„ = cinan-i . . . ai, H„ = 0102 . . . a„ and denote 
Sr = rainar{i,j)ar-i{j,k)(y^ar{i,j)ar-^i{j,k)y^, 2 <r <n 

i.j,k ^ — ^ 
j 

Sr = mmar{i,j)ar+i{j,k){y^ar{i,j)ar+i{j,k)y^, 1 < r < n - 1. (4.15) 

3 

Suppose that 

00 

Sr = <X) 

r=2 
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Then the products and Hn can he presented as follows: 

Hn = D„[{cn{l)l, . . . ,Cnim)l) + (pn], H„ = l)„ [(c(l) 1 , . . . , c(m) 1) + (^„] , 

(4.16) 

where: 

Dn and Dn are diagonal matrices with positive diagonal elements; 

HnW < n"=l (1 - "^^r), 0n < 11^=2(1 " "^^r)/ 

c(j) are strictly positive numbers which are uniquely defined by the sequence 
{cifc}fc>i; do not depend on n, and such that c{j) =■ 1; 

Cn(j) are strictly positive numbers with c„(j) — 1 (note that Cn{j), unlike 
the c{j), do depend on n and, generally, do not have a limit). 

Proof. Present Hn as follows: 

Hn = DnD~^aiDn-lD~^-^a2 . ■ ■ D^^Qn = Dndia2 ...an 

where dr = D~^^_^_-^arDn-r, -Do =^ I, and Dn-r = diag (D„_r(l), Dn-r{rn)) 
are diagonal matrices, with Dn-r{i) chosen so that to make matrices dr stochas- 
tic. It is very easy to see that the only such choice is given by 

Dn-r{i) = ^ flr+l ar+2 (ir+1, ir+2) • • • a™ 

and 

ar{i,j)Y.i,.^,...,i„0.r+l{3,ir+l)...an{in-uin) 

ar{^,J) = ^ ^ s j^. ^ T. r^>5r. (4.17) 

2-^ir)ir+i,---,in l,^r; ^r+lj • • • an V^n— 1? ^n/ 

It is well known that the last estimate implies the following presentation of the 
product of stochastic matrices a„: 

aia2...a„ = (c„(l)l, . . . , c„(m)l) + (^„, 

where 

min a„(i,j) < c„(j) < max a„(i,j) (4.18) 
and the matrices 0„ are such that 

n-l 

UnW < l[{l-mSr). 

r=l 

□ 



4.3 A stability estimate. 

The stability property which we explain below is definitely well known to spe- 
cialists in the relevant field. Given that the proof is very short, it seems that it 
is easier for us to prove it than to find a relevant reference. 

Let bn and b'^ be two sequences of transformations of a metric space (X, t) 

and Xn+i '= bn{xn), x'nj^i =^ i>'n{x'n) , H > 1, with given initial values xi, x'^ e X. 

For any two transformations h and b' put p{b,b') =^ sup^.^^ ^(^(a;), ^'(a;)) 
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Lemma 16 Suppose that 

(a) bn are uniformly contracting, that is there is a c, < c < 1, such that 
for any x,y G H we have r(5„(x), 6„(y)) < cv{x,y); 

(b) p{bn, b'„) — > as n ^ oo. 
Then x{xn, x'^) ^ as n ^ oo. 

//, instead of (b), a stronger property holds, namely p(6„, b[J < C2Cqp(6i, b[) 
for some C2 and cq < 1, then for e > there is a constant C3 such that 

x.{xmx'j^) < C'iC^{p{bi,b'i) + X-{xi,Xi)), w/iere c = max(c, Co) + e. (4-19) 

Proof. Put dn p{bn,b'^) and r„ r(a;„, x^). Since 

z{xn+i,x'^+i) ^t{bn{xn),b'^{x'J) < r(6„ (a;„ ) , 6„ «)) + r(6„ «) , fe^, « )) 

< CX{Xn,x'„) + p{bn,b'J, 

we have that 

rn+l < Crn + dn < dn + crf„_i + ... + c''d„_fe + c'^+Vn-fc. (4.20) 

For a given e > choose k so that c''V„_fc < e (which is possible because X is 
a compact space and thus r„_fc is a uniformly bounded sequence). Next choose 
iV(e, k) so that < e when n — j > N(e, k) — k. It follows now from (|4.20p 
that r„ < (2 — c)(l — c)^^e when n > N{e, k). This proves the first statement 
of the Lemma. 

To prove the second statement substitute k = n into (|4.20p and take into 
account the stronger estimates for dn- Estimate (|4.19p follows with an evident 
choice of C3. □ 

Remark. The second statement of this Lemma does not use the fact that X 
is a compact space. 
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